SYSTEM FOR PROCESSING OBJECT AREAS OF AN IMAGE 



BACKGROUND OF THE INVENTION 

Field Of The Invention 

The present invention relates to systems 
for processing pixel data. More specifically, the 
present invention concerns image processing systems 
in which input pixel data is processed based on 
detected characteristics of the pixel data. 

Incorporation By Reference 

Commonly-assigned U.S. Patent Applications 
Serial No. 07/873,012, now U.S. Patent No. 
5,680,479, entitled "Method and Apparatus For 
Character Recognition", Serial No. 08/171,720, now 
U.S. Patent No. 5,588,072, entitled "Method and 
Apparatus For Selecting Text And/Or Non-Text Blocks 
In A Stored Document", Serial No. 08/338,781, 
entitled "Page Analysis System", Serial No. 
08/514,250, now U.S. Patent No. 5,774,579, entitled 
"Block Selection System In Which Overlapping Blocks 
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Are Decomposed" , Serial No. 08/514,252, now U.S. 
Patent No. 5,848,186, entitled "Feature Extraction 
System", Serial No. 08/664,674, entitled "System For 
Extracting Attached Text", Serial No. 08/751,677, 
5 entitled "Page Analysis System", Serial No. 

08/834,856, now U.S. Patent No. 5,825,944, entitled 
"Block Selection Review and Editing System", Serial 
No. 09/002,684, entitled "System For Analyzing Table 
Images", Serial No. 09/161,716, entitled "Color 
10 Block Selection", and Serial No. 09/222,860, 

entitled "Block Selection Of Table Features", are 
herein incorporated as if set forth in full. 

Description Of The Related Art 

15 Conventional image processing systems such 

as a color copier obtain pixel data by scanning an 
original document, and perform various image 
processing steps on the data to produce output data 
suitable for delivery to a laser beam reproduction 

20 engine, an ink jet reproduction system, or the like. 

In particular, conventional image processing 
systems, such as that in U.S. Patent Application No. 
(CFM 595 US) , entitled "Image Processing Apparatus 
And Method", first receive red (R) , green (G) and 

25 blue (B) signals representing a scanned image from a 

charge -coupled device (CCD) . The received signals 
are then subjected to image processing. 

Fig. 1 is a diagram illustrating such image 
processing. As shown in Fig. 1, image signals 

3 0 output from a CCD are input to analog signal 

processing unit 101, wherein the signals are 
processed with gain and offset adjustment. Next, 
each of the R, G and B signals is converted into an 
8 -bit digital image signal, Rl, Gl, and Bl, 

35 respectively, by A/D converter 102. These signals 

are then input to shading correction circuit 103 for 
application of shading correction to each signal. 



Line delay circuits 104 and 105 are used to 
compensate for spacing of sensors within the CCD so 
as to match timing between each of the Rl, Gl and Bl 
signals such that, after line delay circuit 105, 
values of the R, G and B signals at a same point in 
time represent a same pixel. 

Input masking unit 106 converts a reading 
color space, determined by color decomposition 
characteristics of the CCD, into a standard color 
space, and log converter 107 converts luminance 
signals R4 , G4 and B4 into density signals CO, M0 
and Y0 . The density signals are delayed by line 
delay memory 108 until determination signals UCR 
(under color removal) , FILTER and SEN can be 
generated as described below. 

After delay of the signals by line delay 
memory 10 8, masking UCR circuit 10 9 extracts black 
signals from the density signals using the UCR 
signal and variable magnification circuit 110 
expands and compresses an image signal and a black 
character determination signal in the main scanning 
direction. Space filter processing unit ill 
performs filtering using the FILTER signal and the 
resulting frame- sequential image signals M4 , C4 , Y4 
and Bk4 are sent to reproduction engine 112 along 
with the SEN signal, which determines the resolution 
at which the image is output. 

According to Application No. (CFM 5 95 US) , 
the foregoing UCR, FILTER and SEN signals are output 
from black character determination unit 113. 
Specifically, the UCR signal generated by black 
character determination unit 113 has a value from 0 
to 7 indicating, from more black to less black, an 
amount of black component which should be removed 
from signals Yl, Ml and CI by masking UCR circuit 
109 to produce signal Bk2 . The FILTER signal 
produced by black character determination unit 113 



is a 2 -bit value in which values 0 / 1, 2 and 3 
indicate smoothing, strong edge enhancement, medium 
edge enhancement , and weak edge enhancement , 
respectively. Accordingly, the FILTER signal is 
input to space filter processing unit 111 to control 
an amount and type of filtering applied to signals 
Y3 , M3 , C3 and Bk3 . 

The SEN signal is output from black 
character determination unit 113 to reproduction 
engine 112, and is a 1-bit signal in which a 0 value 
indicates to engine 112 that printing should proceed 
at 200 lines per inch resolution, and the value 1 
indicates that 400 lines per inch printing is 
required. 

The values of UCR, FILTER and SEN are 
outputs of look-up table (LUT) 117, which receives 
signals indicating a width of a character containing 
a subject pixel, a proximity of the subject pixel to 
an edge of a character, and a chromaticity of the 
subject pixel. Therefore, the output values of UCR, 
FILTER, and SEN are calculated for each subject 
pixel and are determined based on a detected 
character width, edge proximity and chromaticity 
corresponding to the pixel according to 
relationships specified by the LUT. 

For example, a FILTER signal value of 1 is 
used for a subject pixel which is located near to an 
edge, has high chromaticity and is included in a 
relatively thin character, since such factors 
suggest that the pixel is within a small, black 
character. In another example, the SEN signal is 
assigned a value of 0 (corresponding to 2 00 lines 
per inch resolution) in a case that the subject 
pixel is not near an edge and is included in a very 
thick area, since larger toner dots, which provide 
more toner per unit area than larger dots, generate 
a better halftone image. 



As described above, line delay memory 10 8 
delays the signals until the UCR, FILTER and SEN 
signals are generated by unit 113. Moreover, each 
pixel in the scanned document must be processed by 
unit 113 . Accordingly, the above -de scribed 
functions of elements 114 to 116 present a 
bottleneck to image processing speed. 

It has therefore been contemplated to use 
software to perform the image processing functions 
of unit 113. However, conventional software 
implementations of these functions require extremely 
long processing times in comparison to hardware 
arrangements . 

In view of the foregoing, what is needed is 
an image processing system which reduces processing 
time by reducing delays caused by hardware elements 
such as unit 113. 

SUMMARY OF THE INVENTION 
The present invention addresses the 
foregoing by utilizing results of block selection 
processing to determine software processes to be 
applied to pixel image data. By using the results 
of block selection processing, it can be determined 
whether a pixel should undergo significant 
processing, minimal processing or no processing at 
all. As a result, image processing is flexible and 
executable at speeds comparable to hardware -based 
processing. 

Particularly, the present invention 
concerns a system in which pixel data of an image is 
input and block selection processing is performed on 
the pixel data to determine types of pixels within 
the pixel data. Next, it is determined, based on 
the block selection processing, if a pixel is in an 
obj ect area of the image and, if the pixel is 
determined to be in an object area of the image a 



proximity of the pixel to an edge is detected. 
These features provide fast overall processing by 
detecting edge proximity only for those pixels which 
are determined to be in object areas of the image. 

In related aspects, the invention also 
contemplates detection of pixel chromaticity and a 
width of a character including a pixel if the pixel 
is determined to be in an object area of the image. 

This brief summary has been provided so 
that the nature of the invention may be understood 
quickly. A more complete understanding of the 
invention can be obtained by reference to the 
following detailed description of the preferred 
embodiment thereof in connection with the attached 
drawings . 

BRIEF DESCRIPTION OF THE DRAWINGS 
Fig. 1 is a block diagram showing a flow of 

an image signal within a conventional image 

processing unit. 

Fig. 2 is a sectional view of a color 

copier according to an embodiment of the present 

invention. 

Fig. 3 is a view of a document containing 
pixel data for processing according to the present 
invention . 

Fig. 4 is a flow chart of processor- 
executable process steps to process pixel data 
according to the present invention. 

Fig. 5 is a representative view of object 
areas identified by block selection processing. 

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS 
Fig. 2 shows a sectional view of an image 
processing apparatus according to one embodiment of 
the present invention. In the apparatus of Fig. 2, 
image scanner 2 01 reads an original document, and 



digitally processes read pixel data of the original 
document into digital signals. Printer 200 then 
prints out an image corresponding to the original 
document read by image scanner 201 on a printing 
sheet in full color. 

In image scanner 201, original document 2 04 
is set on a platen glass covered with a document 
cover 202, and exposed by halogen lamp 205. The 
reflected light from original document 2 04 is 
further reflected by mirrors 206 and 207, then 
focuses on CCD 210 for identifying R, G, and B 
signals after passing through the lens 208. It 
should be noted that lens 208 is covered by infrared 
filter 231. 

In the preferred embodiment, each row of 
sensors in CCD 210 for reading respective color 
components is composed of 5000 pixels, thus CCD 210 
can read across the shorter side of an A3-sized 
original, namely 2 97 mm, at 400 dpi resolution. CCD 
210 separates color information of original document 
204 into full-color information of R, G and B 
components, and converts the full-color information 
into color signals. 

In addition, standard white board 211 
generates correction data for correcting read data 
by R, G, B photo sensors 210-1 to 210-3 of CCD 210. 
Standard white board 211 has uniform reflection 
characteristics in the visible light range, and 
appears white. After correcting the data, CCD 210 
then sends the signals to signal processing unit 

209 . 

It should be noted that, halogen lamp 205 
and mirror 2 06 move at speed v, and mirror 207 moves 
at speed (l/2)v in a perpendicular direction with 
respect to an electrical scanning direction of CCD 

210 (a main scanning direction) . The, entire 
original document 2 04 is scanned in this manner. 
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Further, in signal processing unit 209, the read 
signals produced by the scanner are electrically- 
processed and separated into color components of 
magenta (M) , cyan (C) , yellow (Y) , and black (Bk) , 
5 then stored before being sent to printer 200. 

In printer 2 00, each image signal of M, C, 
Y, and BK from image scanner 201 is sent to laser 
driver 212. Laser driver 212 drives semi-conductor 
laser 213 by signals modulated on the basis of the 

10 image signals. The laser beam scans electrostatic 

drum 217 via polygon mirror 214, f-0 lens 215, and 
mirror 216. 

The developer unit is composed of magenta 
developer 219, cyan developer 22 0, yellow developer 

15 221, and black developer 222. These four drums 

touch electrostatic drum 217, are configured to turn 
therewith, and develop latent images of M, C, Y and 
Bk formed on electrostatic drum 217 with the 
corresponding color toner. Further, transfer drum 

20 223 attracts a paper sheet fed from paper cassette 

224 or 22 5, and a toner image developed on 
electrostatic drum 217 is transferred onto the paper 
sheet. The paper sheet is then ejected after 
passing through fixing unit 226. 

2 5 Fig. 3 is a view of a document containing 

image data for processing according to the present 
invention. Shown in Fig. 3 is document 3 00, which 
contains several types of pixel data, including 
title data 301, text data 302, image data 304, line 

3 0 drawing data 3 05 and table data 306. Of course, any 

other document containing these or other types of 
pixel data can be processed according to the present 
invention: In this regard, Fig. 4 is a flow chart 
of process steps to process pixel data of a document 
3 5 according to the present invention. 

Generally, the Fig. 4 process steps involve 
input of pixel data of a document, performance of 



block selection processing on the pixel data to 
determine types of pixels within the image data, 
determination, based on the block selection 
processing, of whether a pixel is in an object area 
of the document, and processing of the pixel data 
according to the object area. Such processing may 
include detection of a proximity of the pixel to an 
edge, detection of a thickness of a character 
including the pixel, detection of chromaticity of 
the pixel, or the like. 

Flow begins at step S401, wherein a 
document is scanned at a low resolution. As 
described above with respect to Fig. 2, such 
scanning is performed by image scanner 201 in the 
preferred embodiment. Of course, other systems for 
scanning a document can be used in step S401. The 
document is scanned at a low resolution in step S4 01 
in order to reduce processing time, since low 
resolution scanning traditionally occurs more 
quickly then high resolution scanning. In addition, 
Applicant has discovered that low resolution pixel 
data provides satisfactory results when subjected to 
subsequent block selection processing. 

Accordingly, in step S402, block selection 
processing is performed on the pixel data to produce 
a "blocked" representation of the scanned document. 
Such a representation is shown in Fig. 5 as 
representation 500. Any conventional block 
selection (or page segmentation) technique can be 
utilized in step S402, including those described in 
the applications and patents listed above and 
incorporated by reference herein. 

In general, block selection techniques 
identify areas within an image and assign attributes 
to the identified areas, such as picture, text, 
title, table, line drawing or the like. As 
described in the above-listed applications and 
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patents, many other types of attributes may be 
assigned to the identified areas. 

Next, in step S4 04, the document is scanned 
at a high resolution. The high resolution data is 
used to produce an output image, therefore high 
resolution data is preferable to low resolution 
data. In another embodiment of the invention, the 
document is scanned at high resolution at step S4 01 
and converted to low resolution for subsequent 
performance of block selection processing in step 
S402 on the low resolution image. Accordingly, in 
this alternative embodiment, step S4 04 is not 
performed. 

After a high resolution image is scanned in 
step S404 of the present embodiment, data of a first 
high-resolution pixel is retrieved in step S405. It 
is then determined in step S406 whether the 
retrieved pixel is in an object area of the 
document. In a preferred embodiment, only text 
areas are considered to be object areas. Of course, 
depending on a user's preference, line, line art, 
title or table areas may also be considered to be 
object areas. Also in the preferred embodiment, the 
determination in step S4 0 6 is performed by 
determining coordinates of the pixel and comparing 
those coordinates with blocked image areas such as 
those shown in representation 500. If the pixel 
coordinates are within the coordinates of a blocked 
area, the determination in step S406 is positive. 
Accordingly, flow proceeds to step S407 to process 
the pixel data according to the object area in which 
the pixel resides. As shown in Fig. 4, if, in step 
S406, it is determined that the retrieved pixel is 
not in an object area of the document, flow 
continues directly to step S409. 

Pixel processing can proceed in many ways. 
In a preferred embodiment, the Fig. 4 steps are 
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embodied in a module to provide functionality 
similar to unit 113. Accordingly, software methods 
can be applied to the "object area" pixels to 
provide functions similar to that provided by 
character thickness determination unit 114, edge 
detector 115 or chromaticity determination unit 116. 
Since only selected pixels are processed, delays 
caused by black character determination can be 
reduced in comparison to conventional systems. Of 
course, any other processing can be performed on the 
pixel in step S407. 

In step S409, it is determined whether the 
pixel is a last pixel in the image. If not, flow 
proceeds to step S410. A next high resolution pixel 
is retrieved from step S410 and flow continues 
therefrom to step S406 as described above. 

Finally, if it is determined in step S409 
that a last retrieved pixel is the last pixel in the 
obtained pixel data, the Fig. 4 flow process steps 
terminate . 

While the present invention is described 
above with respect to what is currently considered 
its preferred embodiments, it is to be understood 
that the invention is not limited to that described 
above. To the contrary, the invention is intended 
to cover various modifications and equivalent 
arrangements included within the spirit and scope of 
the appended claims. 



